2 links tagged with all of: classification + jev + cost efficiency
Click any tag below to further narrow down your results
Links
Researchers tested an AI system called Jev on 2,029 real phone calls stripped down to pure call structure—no audio or transcripts—and it learned to predict which calls would result in bookings with 94% accuracy by the end, all for $3 in compute costs.
- Jev made 38,012 turn-level forecasts across the calls at 118ms median latency, processing thousands of calls in seconds without any fine-tuning or examples from the company's data.
- The system achieved 0.78 AUC by the halfway point and reached 94% ranking accuracy near the end, learning to separate bookable from non-bookable calls based solely on call structure, timing, and workflow patterns.
- The experiment revealed the AI could extract predictive signal from call metadata alone—turns, tool calls, workflow stages—demonstrating that meaningful patterns exist independent of what's actually said.
Jev is a new AI model that classifies data and answers specific questions 193x faster and 444x cheaper than LLMs, but it's fundamentally different—it's a modernized BERT-style classifier, not a generative model. The author tested it on Croatian text classification and found it matched a fine-tuned model's accuracy while costing pennies and taking minutes.
- Jev achieves 97.1% accuracy on zero-shot binary classification tasks, essentially matching fine-tuned BERT models without requiring retraining
- It costs around 20 cents for 3,000 classifications and completes in about a minute, making it practical for real-world workloads where LLMs are overkill
- The model appears more resistant to prompt injection attacks because instructions are separated from input data during training, unlike LLMs where everything blends together
- Jev's "can't hallucinate" claim means it can't generate outputs outside its specified structure (type-safe), but it can still produce incorrect answers within that structure